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Abstract — We consider the recovery of a nonnegative vector x 
from measurements y = Ax, where A e {0, i} mxn . We establish 
that when A corresponds to the adjacency matrix of a bipartite 
graph with sufficient expansion, a simple message-passing algo- 
rithm produces an estimate x of x satisfying \\x— x\\ 1 < O ( ^ ) 1 1 x— 
where x^ k ' is the best fc-sparse approximation of x. The 
algorithm performs 0(ri(log(| : )) 2 log(fc)) computation in total, 
and the number of measurements required is m = 0(fclog(-^)). 
In the special case when x is fc-sparse, the algorithm recovers 
x exactly in time 0(n log(§) log(fe)). Ultimately, this work is 
a further step in the direction of more formally developing the 
broader role of message-passing algorithms in solving compressed 
sensing problems. 

I. Introduction 

Recovery of a vector x from measurements of the form 
y = Ax has been of central interest in the compressed sensing 
literature. When restricted to binary vectors, this has been 
of interest in the context of binary linear error-correcting 
codes. In essence, both desire a matrix A and an estimation 
or decoding algorithm that allows for faithful recovery of x 
from y. In this paper, we study the performance of a message- 
passing recovery algorithm when the matrix A corresponds to 
the adjacency matrix of a bipartite graph with good expansion 
properties. Results of a similar flavor are well-known in the 
context of coding, but have only begun to be explored in the 
context of compressed sensing. 

As background, there is now a large body of work in 
compressed sensing. Both (T) and Q, proposed using 
linear programming (LP) to find the sparsest solution to 
y = Ax. Since then, many algorithms have been proposed ||4]- 
lfl3l — see, e.g., Ifl3l for a summary of various combinations 
of measurement matrices and algorithms, and their associated 
performance characteristics. Most existing combinations fall 
into two broad classes. In the first class, inspired by high- 
dimensional geometry, the measurement matrix A is typically 
dense (almost all entries nonzero), and recovery algorithms are 
based on linear or convex optimization. The second class con- 
sists of combinatorial algorithms operating on sparse measure- 
ment matrices (A typically has only 0(n) nonzero entries). 
Examples include the algorithms of |11|-[13|. In particular, 
Algorithm 1 from ifTTl can be viewed as essentially the Sipser- 
Spielman message-passing algorithm [14]. The algorithm we 
consider in this paper also falls into the second class, and is a 
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minor variant of the algorithm proposed in lfl5l . Very recent 
work on the use of a message-passing algorithm to identify 
compressed sensing thresholds appears in fl6l . IfTTl . Relative 
to the present paper, [ 16] and ifTTll are more general in that ar- 
bitrary (i.e., even dense) matrices A are considered. However, 
lfl6l . IfTTl restrict attention to a probabilistic analysis, while 
we perform an adversarial analysis, and thus we are able to 
provide deterministic reconstruction guarantees for arbitrary 
(nonnegative) x. 

On the coding theory side, Gallager introduced a class of 
binary linear codes known as low-density parity check (LDPC) 
codes, and proposed a computationally efficient message- 
passing algorithm for their decoding ifTHl . Since then, an enor- 
mous body of work has analyzed the performance of message- 
passing algorithms for decoding such codes. In particular, 
[14] showed that when the parity check matrix of an LDPC 
code corresponds to the adjacency matrix of a bipartite graph 
with sufficient expansion, a bit-flipping algorithm can correct 
a constant fraction of errors, even if the errors are chosen 
by an adversary. In fl9l . this result is extended by showing 
that a broad class of message-passing algorithms, including 
common algorithms such as so-called "Gallager A" and "B" 
also correct a constant fraction of (adversarial) errors when 
there is sufficient expansion. Finally, |20| suggested decoding 
LDPC codes via LP, and [21 1 proved that this LP decoder can 
correct a constant fraction of (adversarial) errors when there 
is sufficient expansion. We show that similar techniques can 
be used to analyze the performance of the message-passing 
algorithm proposed in this paper. 

The contribution of this paper is the adversarial analysis of 
a simple message-passing algorithm for recovering a vector 
x G i?" from measurements y = Ax G where 
A G {0, l} mxn . Our first result concerns exact recovery in the 
case that x has at most k nonzero entries. We show formally 
that when A corresponds to a bipartite graph with expansion 
factor greater than 0.5, the message-passing algorithm recovers 
x exactly. Choosing an appropriate expander, we find that the 
message-passing algorithm can recover x from 0(fclog(r)) 
measurements in time 0(n log(r) log(fc)). Compared to the 
Sipser-Spielman algorithm 1141 . this algorithm requires less 
expansion (0.5 vs. 0.75), but the Sipser-Spielman algorithm 
works for arbitrary (i.e., not just nonnegative) vectors x. 
Finally, ll22l shows that recovery of nonnegative x is possible 
from far less expansion, but their algorithm is significantly 
slower, with a running time of 0(nk 2 ). 



As our second result, on approximate recovery, we show that 
when A corresponds to a bipartite graph with expansion factor 
greater than 0.5, the message-passing algorithm produces an 
estimate x with £i/£i error guarantee \\x — x\\i < 0( 7 j;)\\x — 
x( k '\\i, where x^ is the best fc-sparse approximation of x. 
The running time of the algorithm is 0(n(\og(^)) 2 log(fc)), 
and the number of measurements used is m = 0(fclog(^)). 
In the regime where k scales linearly with n, our algorithm 
is faster than almost all existing algorithms, e.g., 0, (9), 
ifTUl ; the only exception is iTPTl . which is faster, and stronger, 
in that the multiplier O(^) in the £±/£i guarantee is only 
(1 + e). However, relative to the algorithm of [13], ours has 
the advantage of working with a smaller expansion factor 
(albeit at the cost of requiring expansion from larger sets), 
and is easily parallelizable. In addition, we believe that this 
message-passing algorithm may be applicable in more general 
settings, e.g., providing guarantees for recovering "random" 
vectors when the graph is not an expander, but possesses other 
properties, such as large girth. 

Beyond the specific results above, this work can be viewed 
as a further step toward formally connecting the theory of 
message-passing algorithms with that of compressed sensing, 
which we anticipate being of growing importance to further 
advances in the field. 

II. Problem Model 

As our problem model, we seek to estimate a vector x G R™ 
of interest from observations of the form y = Ax G R™, 
where A = [Aij] G {0,l} mXTl is a known measurement 
matrix. Associated with A is the following bipartite graph 
G = (X, Y, E). First, X = {1, . . . , n}, Y = {1, . . . , m} and 
E = elxf: Aij = 1}. Next, associated with vertex 

i G X is Xi, the ith component of x, and with vertex j £ Y 
is yj, the jth component of y. Further, 

N x (i) = {j EY : G E}, for all i G X, 

N y (j) = {ieX j) G E}, for all j G Y. 

Note that the degrees of i G X, j G Y are \N x (i)\, \N y (j)\, 
respectively. The structure in A is specified via constraints 
on the associated graph G. Specifically, G is a (c, <i)-regular 
(fc, a)-expander, defined as follows. 

Definition 2.1 (Expander): A given bipartite graph G — 
(X, Y, E) is a (c, <i)-regular (fc, a)-expander if every vertex 
iel has degree c, every vertex j eY has degree d, and for 
all subsets S C X such that \S\ < k we have |r(5)| > ac\S\, 
where T(S) 4 U iES N x (i). 

III. An Iterative Recovery Algorithm 

The message-passing algorithm for iteratively recovering 
x is conceptually very simple. The algorithm maintains two 
numbers for each edge (i, j) G E, corresponding to a message 
in each direction. Let t > denote the iteration number and 
vnfl,j-,in'j\i denote the two messages along edge (i,j) G E 
in the t th iteration. The principle behind the algorithm is to 
alternately determine lower and upper bounds on x. Specifi- 
cally, and ^nf-^i ^ l° wer bounds on Xi for all t > 0; 



mf^ 1 and m^i^ are upper bounds on Xi for t > 0. Also, 
these lower (respectively, upper) bounds are monotonically 
increasing (respectively, decreasing). That is, 

ml^j < m?_^ < . . . ; m}^ > mf_^ > . . . 
Formally, the algorithm is given by the following pseudocode. 



IV. Main Results 

Our results on the performance of the message-passing 
algorithm are summarized in the following two theorems. The 
first establishes that the algorithm is able to recover sparse 
signals exactly. 

Theorem 4.1: Let G be a (c, <i)-regular ( Ltt^^+IJ > i+ e )" 
expander, for some e > 0. Then, as long as k > \\x\\v = \{i G 
X : Xi ^ 0}\, the estimate produced by the algorithm satisfies 
i* = x, for all t > T = 0(log(fc)) . 

The second theorem establishes that the algorithm can approx- 
imately recover x that are not exactly fc-sparse. 

Theorem 4.2: Let G be a (c, d) -regular (|_^ + lj, 5 + e)- 
expander, for some e > 0. Let x^ k > denote the best fc-sparse 
approximation to x, i.e., 



Then, for all t > T = 0(log(fc) log(cd)), 

\\ x - x %<(l + £\ \\x-xM\\i. 

As a sample choice of parameters, it is well-known that 
there exist expanders with c = 0(log(j j) and d = O(j). 
With such an expander, we use 0(fclog(r)) measurements. 
The factor multiplying the error in the £i/£i guarantee is 
O(j), and the algorithm can be implemented sequentially in 
0(n(log(£)) 2 log(fc)) time, or in parallel 0(£ log(fc) log(f )) 
time using 0(n) processors. In particular, when fc = G(n) — a 
regime typically of interest in information-theoretic analysis — 
the algorithm provides a constant factor £\ / £\ guarantee with 
0(nlog(n)) running time. 



l: Initialization (t = 0): for all G E, set m?^ - = 0. 
2: Iterate for t = 1, 2, . . . : 

a) t = t+ 1, update messages for all G E via 
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3: Stop when converged (assuming it does). 

Algorithm 1: Recovery Algorithm 



b) Estimate Xi via xf = for s = It — 1, 2t. 
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V. Analysis 

A. Proof of Theorem \4.1\ 

We start by observing a certain monotonicity property 
of the messages. For each i € X, the messages mf^j 
are monotonically nondecreasing lower bounds on X4, and 
the messages mf^ 1 are monotonically nonincreasing upper 
bounds on 2^. This can be easily verified by induction. Given 
this monotonicity property, clearly the messages at even and 
odd times have limits: if these messages are equal after a 
finite number of iterations, then the algorithm recovers x. We 
establish that this is indeed the case under the assumptions of 
Theorem 14.11 

To this end, define Wit = {i € X : Xi > m?^.}, i.e., 
Wit is the set of vertices whose lower bounds are incorrect 
after 2t iterations. Clearly, \Wq\ < k since ||x||o < k, and 
the lower bounds to Xi, m 2 \., are nonnegative for all t. The 
monotonicity property of the lower bounds implies that for 
< s < t, Wn Q Wi s . Therefore, it is sufficient to establish 
that \W 2t+ i\ < (1 - 2e)\W 2t \ if < \W 2t \ < k; this implies 
that after 0(log(fc)) iterations, Wit must be empty. 

Suppose < \Wn\ < k. Since W 2t +i C W 2t , it suffices 
to show that at least a 2e fraction of the vertices in Wit are 
not in Wit+i ■ We prove this by using the expansion property 
of G (or matrix A). Let V = T(W 2t ) C Y be the set of all 
neighbors of W 2t . Let T C X be {i G X : N x (i) C V}. 
Since G is (c, (i)-regular, \V\ < c\W 2 t\- Also, by definition 
Wn C T. We state three important properties of T: 
PI. \T\ < 2\W 2t \/(l + 2e). Suppose not. Then, consider any 

V C T with \T'\ = \2\W 2t \/(l + 2e) + lj. We reach a 
contradiction as follows: 

c\W 2t \> \V\ >|r(T , )|>|T , |(l + 2e)|>|W 2t |c. 

P2. Let U = {i G X : m 2t + 1 > Then, U C T. This is 
because m 2 ^ 1 = Xi if there exists j G N x (i) such that 
j £ V. To see this, note that for such a j, all k G N y (j)\i 
are not in Wit, an d hence xt — w 2 *-^- f° r all these k, 

so Vj - YlkeN y (j)\i = Xi - 
P3. Let T 1 = {i e T : 3j e V s.t. N y (j) flT = {i}}. 
Then, IT 1 ! > 2e\T\. To see this, let A = \{j e V : 
\ N vU) nT| = 1}|, and let B = \V\ — A. Then, number 
of edges between T and V is at least 2B + A, and since 
G is (c, e?) -regular, the number of edges between T and 

V is at most c\T\. Therefore, A + 2B < c\T\. Now, by 
[PI], \T\ < 2k/(l + 2c), so |T(T)| > c[T[(l + 2e)/2. 
Therefore, A + B > c|T|(l + 2e)/2, whence A > 2ec\T\. 

To complete the proof, note that T 1 C W^t, and IT 1 ! > 2e\T\ 
by [P3]. For each i € T 1 , let G ^ be its unique neighbor 
in the definition of T 1 , i.e., N y (j(i)) D T = {£}. Then, [P2] 
implies that for all fc G N y (j(i)) \ i, we have m^jv^ = Xfe. 
Therefore, m^t^ = Xj, so = a;*. Thus, i ^ Wn+i, 

i.e., T 1 C W^t \ Wit+i, completing the proof of Theorem 14. II 

B. Proof of Theorem \4.2\ 

This section establishes Theorem 14.21 in two steps. First, 
using techniques similar to those used to prove Theorem 14.11 



we obtain a very weak bound on the reconstruction error. Next, 
we improve this weak bound, by showing that when the error 
is large, it must be reduced significantly in the next iteration. 
This yields the desired result. 

Given x G K™, let x^ k ' denote the best fc-term approxi- 
mation to x. Let X + = {i e X : x\ k ^ ^ 0}, and let X Q 
X \ X + . For an arbitrary S C X, let e t (S) = J2ies( Xi ~^i) at 
the end of iteration t; recall that x ' is the algorithm's estimate 
after t iterations. Note that x\ s < x t < xf s+1 , so e t (S) > 
for even t, and e t (S) < for odd t. 

Now, we state the first step of the proof, i.e., the weak bound 
on reconstruction error. 

Lemma 5.1: Let G be a (c, d)-regular ( |_ + lj , \ + e)- 
expander, for some e > 0. Then, after t = 0(log k) iterations, 

Wx-x^i < O ((cd)°( log ( fc » log(fc)) ||a;-a; (fc) ||i. 

Proof: We copy the proof of Theorem 14.11 Let V = 
T(X + ) be the set of neighbors of X + , and let S' — {i G 
X : N x (i) C V}. Also, define sets Se,£ > as follows: 

S = X \ S', S 1 = {i€S': 3j G V s.t. N y (j) n S' = {i}}, 

and for t>2, 

s e = {1 eS':3jeV s.t. N v (j) n {S' \ Ut^Sv) = {t}} . 

We note that by arguments similar to those used to establish 
property [P3], it follows that \S e \ > 2e\S' \ U t<e S t \. Also, 
[PI] implies that \S'\ < Therefore, Se is empty for 

£ > 0(logJb). 

Adapting arguments used in the proof of Theorem 14.11 we 
bound e (Si) for I > 0. First, by definition So C Xq, so 
e°(5'o) < \\x - x^Wi. Now, consider e 2 (Si). By definition, 
each vertex i G Si has a unique neighbor j, i.e., a neighbor j 
such that N y (j) \ i C So- Therefore, 

Xi — Xi < ^ ' (ij/ — a;,'). 

Each i' G 5o, so for each i' we have a neighbor j' ^ y, i.e., 
N y (j') c Z . Therefore, 

i"eJV s (j')\i' 

where all i" G Xq. Thus, 

Xi — X^ < ^ ] ^ ] ~ 

i'£N v (j)\i i"£N v (j')\i' 

and summing over all i G S\, we obtain 

ieSi i'£N y {j)\i i"eN v (j')\i' 

Now, we bound the number of times a particular vertex i" G 
can appear on the right-hand side of the above inequality. 
i" can only occur in sums corresponding to a vertex i € Si 
such that there exists a walk of length 4 between i" and i in 
G. Therefore, i" can occur in at most (cd) 2 terms; hence, 

e 2 (Si) < M) 2 e°(5 ). 



Similarly, we can bound e 2l (Si) for I > 1 by induction. 
Assume that for all £' < £, 



„2l" 



(Si') < (cdft'Wx-x^W 



For each vertex i G Si, there exists a unique neighbor j, 
i.e., j satisfies N y (j) \ i C Ug^fSg. Thus, Xi — < 
2~2i'eN — Xi ')- ^ s before, each i' has a unique 

neighbor j', and summing over i G Sf, we obtain 

E E E (^-^- a ). 

iZSti'eN y (j)\i i"£N y U')\i> 

where all i" G \Ji><£-iSt. Again, each i" can only occur 
(cd) 2 times, so we conclude that 

e 2e (S e ) < (cd) 2 E e 2£ - 2 (5,0 < (cd) 2 E 
^'=o e'=o 

< (cd) 2 EM) 2 ''lN-^ (fc) l|i < (cd) 2e '\\x-x {k) \\ u 

£'=0 

where the second inequality is true because of the mono- 
tonicity property of the lower bounds. Thus, we have shown 
inductively that e u (Si) < (cd) 2e \\x - x^\\ x for all I. Since 
there are at most O(logfc) nonempty sets Si, it follows that 
after t = O(logfc) iterations, 



x-x* i < 



E e ^(^) ^ (M)° (log(fe)) log(fc)) ||ar— ac 



(fe)| 



On one hand, Lemma 15.11 gives a weak bound on the 
reconstruction error, as the multiplier is poly(n). On the other 
hand, it provides good starting point for us to boost it to obtain 
a better bound by using the second step described next. To that 
end, we first state a definition and lemma adapted from [21]. 

Definition 5.1: Given a (c, d) -regular bipartite graph G = 
(X,Y,E), let B(S) = {i G X \S : N x (i) f] T(S) > f } for 
any S C X. For a given constant S > 0, a (^-matching is a 
set M C E such that: (a) Mj G Y, at most one edge of M is 
incident to j; (b) V« G S U B(S), at least 5c edges of M are 
incident to i. 

Lemma 5.2: Let G = (X,Y,E) be a (c, d)-regular (|_^ + 
lj , | + e)-expander, for some e > 0. Then, every S C X of 
size at most fe has a i + e-matching. 

To keep the paper self-contained, a proof of Lemma 15.21 is 
provided in Appendix Q] 

We use 5-matchings to prove that the reconstruction error 
decays by a constant factor in each iteration. 

Lemma 5.3: Let G be a (c, c?)-regular + lj, | + e)- 
expander, for some e > 0. Then, 

e 2t+2 (X + ) < \-^e 2 \X + ) + -^- e 2 *(X ). 



l + 2e v l + 2e 

In our proof of Lemma 15.31 we make use of the follow- 
ing lemma establishing a simple invariance satisfied by the 
message-passing algorithm. Since this invariance was used 
earlier in the proof of Lemma 15.11 a proof is omitted. 



Lemma 5.4: For any i G X, construct a set S as follows. 
First, choose a vertex j G N x (i). Next, for each i' G N y (j)\i, 
choose a vertex w(i') G N x (i') (note that these choices can 
be arbitrary). Finally, define S as eN v (j)\iX y (w(i')) \ i'. 
Then, no matter how j and w(i') are chosen, 

Xi - xf t+2) < e - 4 2 '* } )- 

i"es 

Proof of Lemma \53\ Lemma lBTSI guarantees the existence 
of a | + e-matching, say M, for the set X + of (at most) k 
vertices in X. We use this i + e-matching to produce a set of 
inequalities of the form given in Lemma IB~4l By adding these 
inequalities, we prove Lemma 15.31 

For each i G X + , let M[i) be the set of neighbors of i in 
the i+e-matching. We construct an inequality, or equivalently, 
a set S, for each member of M(i). We construct the sets S 
sequentially as follows. Fix i and j G M(i). For each i' G 
N y (j) \ i, we must choose a neighbor w(i'). If j' G X + or 
i' G i?(AT + ), set w(z') to be any vertex in M(i') that has not 
been chosen as w(i') for some previously constructed set. If 
i' e X\(X+UB(X + )), choose i' to be any element of N x (i')\ 
T(X+) that has not been chosen as w(i') for some previously 
constructed set. Although it may not be immediately apparent, 
we will see that this process is well-defined, i.e., i' will always 
be able to choose a neighbor w(i') that has not been used 
previously. First, however, we complete the proof assuming 
. that the process is well-defined. 

To that end, we establish Lemma IB31 by adding together all 
the inequalities associated with the sets S constructed above. 
First, consider the left-hand side of this sum. The only terms 

('2t • 2) 

that appear are Xi — x\ , where i G X + , and each of these 
appears at least + e)c times since |M(i)| > (4 + e)c for 
all such i. On the right-hand side, we must count how many 

(2t) 

times each term Xi — x\ appears in some inequality, i.e., 
how many times vertex i appears in the second level of some 
set S. We break the analysis up into two cases. First, assume 

(2t) 

that i G X + . Then, Xi — x\ can appear in the second level of 
a set S only if some vertex in N x (i) was chosen as w(i') for 
some i' i when we were defining S. This is only possible 
for i' G X + U B(X + ). To bound the contribution due to such 
i' , note that the vertices in M(i) can never be chosen as w(i') 
for i' ^ i, and that every vertex in Ui^x + M(i) is chosen at 
most once. Therefore, Xj, — x[ 2t ^ appears at most (i — e)c 

(2t) 

times. To bound the number of appearances of Xi — x\ for 
i X + , note that any vertex can appear in some set S at 
most cd times. To see this, note that any vertex in Y can 
appear as w(i') for a set S at most d times, once for each of 
its neighbors, because a single vertex in X never chooses the 
same neighbor as its w(i') more than once. The bound then 
follows since each vertex in X has degree c. Hence, 



1 

2 4 

or equivalently, 



< 



1 



-e )ce 2t (X + )+cde 2t (X ), 



c 2t+2 (X + ) < 



l-2e 
l + 2e 



e 2 \X + ) + 



2d 



l + 2e 



e 2t (X ). 



Now we prove the only remaining claim that the process 
for constructing the sets S is well-defined. The analysis above 
implicitly establishes this already. First, note that every i' G 
X + U B(X + ) has at least (i + e)c distinct neighbors that can 
be chosen as w(i'), and by definition every i' G X \ (X + U 
B(X + )) has at least % distinct neighbors that can be chosen 
as w(i'). Therefore, in order to prove that the construction 
procedure for the sets S is well-defined, it suffices to show 
that every vertex can appear as an i', i.e., in the first level 
of some S, at most | times. For i' G X + U B(X + ), at least 
(±+e)cofi"s neighbors are in the |+ e-matching, so any such 
i' appears at most (i — e)c times. For i' G X\(X + UB(X + )), 
by definition N x (i') n T(X + ) < |, so any such £' appears at 
most | times. ■ 
Completing proof of Lemma \4.2\ We combine lemmas 
Ell and \53\ First, from Lemma ED after t = 0(log(fc)) 
iterations, the error satisfies the bound 

||z-z*||l < 0(M°( log ( fc »log(fc))||x-a;W|| 1 . 

Lemma [5731 implies that after an additional 0(log(fc) log(c<i)) 
iterations, the error satisfies 

To see this, apply the inequality 

e^(X + ) < ^|e 2t (X + ) + j^/'iXo) 

repeatedly, and note that e 2t (Xo) is monotonically nonincreas- 
ing as a function of t, so e 2t (X ) < e°(X ). ■ 

Appendix I 
Proof of Lemma [5721 

The following is essentially identical to Proposition 4 and 
Lemma 5 in ll2D . We construct a| + e-matching by analyzing 
the following max-flow problem. Consider the subgraph of G 
induced by the set of left vertices U = S U B(S) and right 
vertices V = T(SUB(S)). We assign a capacity of 1 to every 
edge in this subgraph, and direct these edges from U to V. 
Finally, we add a source s with an edge of capacity (| + e)c 
pointing to each vertex in U, and a sink t with an incoming 
edge of capacity 1 from every vertex in V. If the maximum 
s—t flow in this graph is (i+e)c|C/|, then we have constructed 
a i + e-matching. To see this, recall that if the capacities are 
integral, then the maximum flow can always be chosen to be 
integral, and the edges between U and V with nonzero flow 
values in an integral maximum flow form a | + e-matching. 

To complete the proof, we show that the minimum s — t 
cut in the max-flow problem constructed above is (i + e)c\U\. 
To see this, consider an arbitrary s — t cut sUAUB, where 
A C U and B C V. The capacity of this cut is (| + e)c(\U\ - 
\A\) + \B\ + G, where C is the number of edges between A 
and V — B. Assume that T(A) <f_ B. Then, from the above 
formula it follows that we can produce a cut of at most the 
same value by replacing B by B U r(A). Therefore, without 
loss of generality we can assume that T(A) C B. Now, an 



argument similar to that used to prove PI shows that |A| < 
L^J: \S\ < k, so if \A\ > + 1J. then there exists a set of 
size k' = L^ + 1J with at most c|5| + f < {\ + e)ck' 

neighbors, contradicting the ( + lj , \ + e)-expansion of G. 
Therefore, > (\ + e)c\A\, so the min-cut has capacity 

at least (± + e)c(\U\ - \A\) + (| + e)c\A\ = {\ + e)c\U\. ■ 
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